Top 100 Local LLM Repositories
Ranking
| Ranking | Project Name | Stars | Forks | Language | Open Issues | Description | Last Commit |
|---|---|---|---|---|---|---|---|
| 1 | gpt4all | 77,384 | 8,305 | C++ | 728 | GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use. | 2025-05-27 |
| 2 | anything-llm | 63,020 | 6,889 | JavaScript | 300 | Stop renting your intelligence. Own it with AnythingLLM. Everything you need for a powerful local-first agent experience | 2026-07-09 |
| 3 | LocalAI | 47,448 | 4,217 | Go | 133 | LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required. | 2026-07-09 |
| 4 | textgen | 47,437 | 5,987 | Python | 800 | Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private. | 2026-06-02 |
| 5 | Langchain-Chatchat | 38,277 | 6,221 | Python | 6 | Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like ChatGLM, Qwen and Ll... | 2025-11-10 |
| 6 | khoj | 35,598 | 2,297 | Python | 96 | Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI ... | 2026-06-24 |
| 7 | AionUi | 29,708 | 2,971 | TypeScript | 533 | Free, local, open-source 24/7 Cowork app for OpenClaw, Hermes Agent, Claude Code, Codex, OpenCode, Gemini CLI and 20+ more CLI | Customize your assistants | Star if you like it! | 2026-07-09 |
| 8 | agenticSeek | 26,615 | 2,980 | Python | 29 | Fully Local Manus AI. No APIs, No $200 monthly bills. Enjoy an autonomous agent that thinks, browses the web, and code for the sole cost of electricity. 🔔 Official updates only via twitter @Martin993... | 2026-07-04 |
| 9 | meetily | 22,244 | 2,236 | Rust | 182 | Privacy first, AI meeting assistant with 4x faster Parakeet/Whisper live transcription, speaker diarization, and Ollama summarization built on Rust. 100% local processing. no cloud required. Meetily (... | 2026-06-05 |
| 10 | dyad | 20,883 | 2,513 | TypeScript | 258 | Local, open-source AI app builder for power users ✨ v0 / Lovable / Replit / Bolt alternative 🌟 Star if you like it! | 2026-07-10 |
| 11 | screenpipe | 19,730 | 1,916 | Rust | 69 | YC (S26) | AI that knows what you've seen, said, or heard. Records everything you do, say, hear 24/7, local, private, secure. Connect to OpenClaw, Hermes agent and 100+ apps | 2026-07-10 |
| 12 | code-review-graph | 19,367 | 2,071 | Python | 81 | Local-first code intelligence graph for MCP and CLI. Builds a persistent map of your codebase so AI coding tools read only what matters, with benchmarked context reductions on reviews and large-repo w... | 2026-06-14 |
| 13 | dalai | 12,914 | 1,331 | CSS | 292 | The simplest way to run LLaMA on your local machine | 2024-06-18 |
| 14 | h2ogpt | 11,974 | 1,306 | Python | 292 | Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/ | 2025-10-09 |
| 15 | EverOS | 10,690 | 849 | Python | 34 | One portable memory layer for every AI agent: local-first, Markdown-native, user-owned, and self-evolving across apps, tools, and workflows. | 2026-07-08 |
| 16 | PowerInfer | 9,629 | 586 | C++ | 123 | High-speed Large Language Model Serving for Local Deployment | 2026-05-11 |
| 17 | ipex-llm | 8,862 | 1,428 | Python | 1213 | Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete... | 2026-01-28 |
| 18 | local-deep-research | 8,690 | 767 | Python | 160 | ~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encry... | 2026-07-10 |
| 19 | TencentDB-Agent-Memory | 8,020 | 739 | TypeScript | 47 | TencentDB Agent Memory delivers fully local long-term memory for AI Agents via a 4-tier progressive pipeline, with zero external API dependencies. | 2026-06-26 |
| 20 | opencommit | 7,477 | 437 | JavaScript | 168 | top #1 and most feature rich GPT wrapper for git — generate commit messages with an LLM in 1 sec — works with Claude, GPT and every other provider, supports local Ollama models too | 2026-07-01 |
| 21 | Dayflow | 6,642 | 377 | Swift | 33 | The automatic work journal/time tracker. Privately turns your screen into a timeline of what you actually accomplished. Open-source and local-first. | 2026-07-03 |
| 22 | open-multi-agent | 6,549 | 2,409 | TypeScript | 12 | TypeScript multi-agent orchestration framework. Describe a goal, a coordinator decomposes it into a task DAG that runs on any LLM: Claude, ChatGPT, Gemini, DeepSeek, or local models. | 2026-07-09 |
| 23 | FunClip | 5,903 | 709 | Python | 0 | FunASR-powered video transcription, subtitle generation, and LLM-assisted clipping tool with a local Gradio UI. | 2026-07-07 |
| 24 | whichllm | 5,712 | 301 | Python | 13 | Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly. | 2026-07-08 |
| 25 | holaOS | 5,493 | 391 | TypeScript | 3 | Your super agent for work: local-first, learn your working context in mins and never forget it. | 2026-06-22 |
| 26 | lemonade | 4,848 | 389 | C++ | 296 | Lemonade helps users discover and run local AI apps by serving optimized LLMs right from their own GPUs and NPUs. Join our discord: https://discord.gg/5xXzkMu8Zk | 2026-07-10 |
| 27 | openmed | 4,408 | 531 | Python | 505 | Local-first healthcare AI: clinical NER & HIPAA PII de-identification that runs 100% on-device. 1,000+ medical models, 12 languages, Apple MLX + Python, no cloud, no patient data leaving your network.... | 2026-07-09 |
| 28 | ai-agents-from-scratch | 4,386 | 635 | JavaScript | 10 | Demystify AI agents by building them yourself. Local LLMs, no black boxes, real understanding of function calling, memory, and ReAct patterns. | 2026-05-31 |
| 29 | gptme | 4,355 | 395 | Python | 6 | Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web. Make your own persistent autonomous agent on top! | 2026-07-10 |
| 30 | OpenMemory | 4,320 | 490 | TypeScript | 9 | Local persistent memory store for LLM applications including claude desktop, github copilot, codex, antigravity, etc. | 2026-06-27 |
| 31 | LLamaSharp | 3,737 | 499 | C# | 19 | A C#/.NET library to run LLM (🦙LLaMA/LLaVA) on your local device efficiently. | 2026-07-02 |
| 32 | torchchat | 3,620 | 245 | Python | 79 | Run PyTorch LLMs locally on servers, desktop and mobile | 2025-09-10 |
| 33 | farfalle | 3,533 | 321 | TypeScript | 44 | 🔍 AI search engine - self-host with local or cloud LLMs | 2024-09-27 |
| 34 | surf | 3,478 | 256 | TypeScript | 22 | Personal AI Notebooks. Organize files & webpages and generate notes from them. Open source, local & open data, open model choice (incl. local). | 2026-07-08 |
| 35 | METATRON | 3,297 | 662 | Python | 8 | AI-powered penetration testing assistant using local LLM on linux (Parrot OS) | 2026-04-11 |
| 36 | Local-File-Organizer | 3,287 | 329 | Python | 26 | An AI-powered file management tool that ensures privacy by organizing local texts, images. Using Llama3.2 3B and Llava v1.6 models with the Nexa SDK, it intuitively scans, restructures, and organizes ... | 2024-10-21 |
| 37 | Sidekick | 3,286 | 144 | Swift | 34 | A native macOS app that allows users to chat with a local LLM that can respond with information from files, folders and websites on your Mac without installing any other software. Powered by llama.cpp... | 2026-05-24 |
| 38 | Rapid-MLX | 3,241 | 381 | Python | 29 | The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Drop-in OpenAI replace... | 2026-07-10 |
| 39 | lean-ctx | 3,194 | 295 | Rust | 8 | Control what your AI can see. LeanCTX (Lean Context) is the context intelligence layer for AI agents — one local Rust binary that decides what they read, remembers what they learn, guards what they to... | 2026-07-09 |
| 40 | nexu | 3,193 | 255 | TypeScript | 61 | The simplest desktop client for OpenClaw 🦞 — bridge your Agent to WeChat, Feishu, Slack & Discord in one click. Works with Claude Code, Codex & any LLM. BYOK, Oauth, local-first, chat from your phone... | 2026-04-26 |
| 41 | harbor | 3,127 | 211 | Python | 52 | Stop configuring your AI stack. Start using it. One command brings a complete pre-wired LLM stack with hundreds of services to explore. | 2026-06-21 |
| 42 | openocta | 2,976 | 329 | TypeScript | 22 | Open-source work buddy. Open-source personal desktop AI agent.Double-click install, instant boot, data stays local. Go runtime for office/ITops/marketing workflows. | 2026-07-10 |
| 43 | ramalama | 2,952 | 347 | Python | 70 | RamaLama is an open-source developer tool that simplifies the local serving of AI models from any source and facilitates their use for inference in production, all through the familiar language of con... | 2026-07-09 |
| 44 | llm_aided_ocr | 2,933 | 207 | Python | 0 | Enhances Tesseract OCR output using LLMs (local or API) for error correction, smart chunking, and markdown formatting of scanned PDFs | 2026-03-22 |
| 45 | DeepCamera | 2,889 | 457 | JavaScript | 8 | Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveillance. Local VLM video analysis with Qwen, DeepSeek, SmolVLM, LLaVA, YOLO26. LLM-powered agentic security camera agent — watches, understand... | 2026-06-18 |
| 46 | claude-tap | 2,440 | 226 | Python | 11 | Intercept and inspect Coding Agent API traffic from Claude Code, Codex CLI, Gemini CLI, Cursor CLI, OpenCode, Kimi/Kimi Code, Pi, and Hermes in a local trace viewer. | 2026-07-10 |
| 47 | awesome-local-llm | 2,376 | 281 | - | 7 | A curated list of awesome platforms, tools, practices and resources that helps run LLMs locally | 2026-07-04 |
| 48 | WritingTools | 2,327 | 145 | Swift | 64 | The world's smartest system-wide grammar assistant; a better version of the Apple Intelligence Writing Tools. Works on Windows, Linux, & macOS, with the free Gemini API, local LLMs, & more. | 2026-06-14 |
| 49 | GraphRAG-Local-UI | 2,316 | 294 | Python | 54 | GraphRAG using Local LLMs - Features robust API and multiple apps for Indexing/Prompt Tuning/Query/Chat/Visualizing/Etc. This is meant to be the ultimate GraphRAG/KG local LLM app. | 2024-11-09 |
| 50 | comfyui_LLM_party | 2,300 | 193 | Python | 78 | LLM Agent Framework in ComfyUI includes MCP sever, Omost,GPT-sovits, ChatTTS,GOT-OCR2.0, and FLUX prompt nodes,access to Feishu,discord,and adapts to all llms with similar openai / aisuite interfaces,... | 2026-06-19 |
| 51 | kalosm | 2,210 | 132 | Rust | 43 | Instant, controllable, local pre-trained AI models in Rust | 2026-07-03 |
| 52 | onefilellm | 1,994 | 176 | Python | 3 | Specify a github or local repo, github pull request, arXiv or Sci-Hub paper, Youtube transcript or documentation URL on the web and scrape into a text file and clipboard for easier LLM ingestion | 2026-06-12 |
| 53 | obsidian-textgenerator-plugin | 1,960 | 167 | TypeScript | 25 | Text Generator is a versatile plugin for Obsidian that allows you to generate text content using various AI providers, including OpenAI, Anthropic, Google and local models. | 2026-05-16 |
| 54 | llama2-webui | 1,936 | 202 | Jupyter Notebook | 24 | Run any Llama 2 locally with gradio UI on GPU or CPU from anywhere (Linux/Windows/Mac). Use llama2-wrapper as your local llama2 backend for Generative Agents/Apps. | 2024-03-22 |
| 55 | Dot | 1,909 | 111 | JavaScript | 13 | Text-To-Speech, RAG, and LLMs. All local! | 2024-12-09 |
| 56 | agent-safehouse | 1,902 | 76 | Shell | 15 | Sandbox your local AI agents so they can read/write only what they need | 2026-07-08 |
| 57 | USB-Uncensored-LLM | 1,865 | 412 | HTML | 33 | The ultimate zero-install, portable local AI environment. Run high-quality, uncensored LLMs (Gemma, Qwen, NemoMix) directly from any USB drive or SSD. Fully air-gapped, cross-platform (Win/Mac/Linux),... | 2026-07-04 |
| 58 | WhisperJAV | 1,841 | 159 | Python | 110 | ASR/STT subtitle generator. Uses Qwen3-ASR, local LLM, Whisper, TEN-VAD. Noise-robust for JAV | 2026-05-10 |
| 59 | AIaW | 1,822 | 164 | TypeScript | 56 | AI as Workspace - An elegant AI chat client. Full-featured, lightweight. Support multiple workspaces, plugin system, cross-platform, local first + real-time cloud sync, Artifacts, MCP | 更好的 AI 客户端 | 2026-05-18 |
| 60 | natively-cluely-ai-assistant | 1,797 | 419 | TypeScript | 25 | Natively — Free open-source AI meeting assistant, interview copilot, and note taker. The best alternative to Cluely, Otter, Granola, Final Round AI, Fireflies, and Interview Coder. Real-time transcrip... | 2026-07-10 |
| 61 | Klee | 1,744 | 137 | Swift | 21 | A native macOS AI chat app powered by MLX. 100% local inference on Apple Silicon, no cloud required. Built with ShipSwift. | 2026-03-20 |
| 62 | webclaw | 1,705 | 181 | Rust | 0 | Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server. | 2026-07-02 |
| 63 | OpenMonoAgent.ai | 1,630 | 193 | C# | 11 | (BETA) AI shouldn't have a meter. Unlimited tokens. Forever. Your machine. Your agent. Use it from anywhere. Terminal-native coding agent powered by local LLMs — 100% open source, free forever, and in... | 2026-07-08 |
| 64 | lemonai | 1,550 | 313 | JavaScript | 12 | Lemon AI is the first Full-stack Open-source Self-Evolving General AI Agent, offering a fully local alternative to Agentic platforms like Manus & Genspark AI.🔔 Official updates X(twitter) @LemonAI_... | 2026-02-03 |
| 65 | wechat-cli | 1,530 | 1,582 | Python | 0 | A CLI tool to query your local WeChat data — chat history, contacts, sessions, favorites, and more. Designed for LLM integration. | 2026-04-06 |
| 66 | Lumos | 1,514 | 111 | TypeScript | 23 | A RAG LLM co-pilot for browsing the web, powered by local LLMs | 2025-01-26 |
| 67 | tlm | 1,488 | 53 | Go | 6 | Local CLI Copilot, powered by Ollama. 💻🦙 | 2026-02-22 |
| 68 | rag-from-scratch | 1,476 | 174 | JavaScript | 0 | Demystify RAG by building it from scratch. Local LLMs, no black boxes - real understanding of embeddings, vector search, retrieval, and context-augmented generation. | 2026-03-11 |
| 69 | claude-real-video | 1,455 | 105 | Python | 0 | Let Claude (or any LLM) actually watch a video — scene-aware, deduplicated frames + transcript, from a URL or local file. Runs locally, MIT. | 2026-07-10 |
| 70 | BrowserAI | 1,440 | 138 | TypeScript | 19 | Run local LLMs like llama, deepseek-distill, kokoro and more inside your browser | 2026-06-17 |
| 71 | nextjs-ollama-llm-ui | 1,420 | 331 | TypeScript | 18 | Fully-featured web interface for Ollama LLMs | 2025-06-05 |
| 72 | hyperDB | 1,409 | 89 | Python | 7 | A hyper-fast local vector database for use with LLM Agents. Now accepting SAFEs at $135M cap. | 2025-02-07 |
| 73 | home-llm | 1,375 | 140 | Python | 35 | A Home Assistant integration & Model to control your smart home using a Local LLM | 2026-07-07 |
| 74 | rocketnotes | 1,336 | 73 | TypeScript | 15 | ✨ AI-powered markdown editor - leverage LLMs with your documents - 100% local or in the cloud | 2026-04-23 |
| 75 | alpaca-electron | 1,309 | 138 | JavaScript | 34 | The simplest way to run Alpaca (and other LLaMA-based local LLMs) on your own computer | 2024-04-04 |
| 76 | local-llm | 1,300 | 80 | Shell | 2 | Everything I know about running LLMs locally | 2026-07-08 |
| 77 | SeaGOAT | 1,299 | 93 | Python | 35 | local-first semantic code search engine | 2026-07-06 |
| 78 | sre | 1,284 | 197 | TypeScript | 6 | The SmythOS Runtime Environment (SRE) is an open-source, cloud-native runtime for agentic AI. Secure, modular, and production-ready, it lets developers build, run, and manage intelligent agents across... | 2026-04-03 |
| 79 | OpenBiliClaw | 1,267 | 75 | Python | 30 | 本地私有的跨平台 AI 内容发现 Agent——先深度理解你，再主动去 B站/小红书/抖音/YouTube/X/知乎/Reddit 找你会喜欢的内容。Local-first AI agent that learns who you are, then hunts content you'll love across platforms. | 2026-07-10 |
| 80 | sage | 1,263 | 116 | Python | 23 | Chat with any codebase in under two minutes | Fully local or via third-party APIs | 2024-11-11 |
| 81 | ollama-gui | 1,249 | 159 | Vue | 7 | A Web Interface for chatting with your local LLMs via the ollama API | 2025-08-05 |
| 82 | wuphf | 1,206 | 92 | Go | 12 | YC S26 | WUPHF by Nex.ai lets you spin up your personal office of AI teammates who collaborate over shared context. Supports Claude Code, Codex, OpenClaw, OpenCode, local LLMs. | 2026-07-09 |
| 83 | DataInfra-RedactionEverything | 1,146 | 166 | TypeScript | 0 | DataInfra Series. Redact EVERYTHING with local llms and vlms. | 2026-07-08 |
| 84 | ai-file-sorter | 1,145 | 125 | C++ | 14 | Cross-platform desktop application for content-aware file organization and renaming. Supports local and remote LLMs, preview-based workflows, and fully user-controlled changes. | 2026-07-09 |
| 85 | reverser_ai | 1,109 | 82 | Python | 0 | Provides automated reverse engineering assistance through the use of local large language models (LLMs) on consumer hardware. | 2026-05-20 |
| 86 | graphrag-local-ollama | 1,102 | 163 | Python | 50 | Local models support for Microsoft's graphrag using ollama (llama3, mistral, gemma2 phi3)- LLM & Embedding extraction | 2026-05-08 |
| 87 | Local-LLM-Comparison-Colab-UI | 1,100 | 157 | Jupyter Notebook | 6 | Compare the performance of different LLM that can be deployed locally on consumer hardware. Run yourself with Colab WebUI. | 2026-01-13 |
| 88 | chatd | 1,080 | 76 | JavaScript | 26 | Chat with your documents using local AI | 2024-07-06 |
| 89 | Atomic-Chat | 1,057 | 110 | TypeScript | 14 | Local AI app and inference engine for agents. Run open-weight LLMs locally — private, 100% offline on your computer. | 2026-07-09 |
| 90 | web-search-mcp | 1,011 | 152 | TypeScript | 20 | A simple, locally hosted Web Search MCP server for use with Local LLMs | 2025-08-08 |
| 91 | ollama-mcp-bridge | 976 | 112 | TypeScript | 15 | Bridge between Ollama and MCP servers, enabling local LLMs to use Model Context Protocol tools | 2025-04-20 |
| 92 | TokenTracker | 959 | 93 | JavaScript | 4 | Track token usage across 25 AI coding tools — Claude Code, Codex, Cursor, Gemini, Kiro, OpenCode, Antigravity, Copilot, Kimi, CodeBuddy, WorkBuddy, Grok, Kilo, Roo, Zed, Goose, Mimo, ZCode & more — lo... | 2026-07-10 |
| 93 | rag-tutorial-v2 | 958 | 607 | Python | 7 | An Improved Langchain RAG Tutorial (v2) with local LLMs, database updates, and testing. | 2024-08-03 |
| 94 | ellama | 948 | 62 | Emacs Lisp | 21 | Work with local and cloud LLMs from Emacs. | 2026-07-06 |
| 95 | OpenOSINT | 946 | 139 | Python | 3 | AI-powered OSINT agent with interactive REPL, MCP server, and CLI. 16 tools. Works with Claude, GPT-4, or local models. For authorized security research only. | 2026-07-07 |
| 96 | LLMs-local | 924 | 96 | - | 0 | list of awesome platforms, tools, and resources run for LLMs locally | 2026-06-10 |
| 97 | murmure | 907 | 88 | TypeScript | 6 | Fully local, private and cross platform Speech-to-Text with LLM Post-processing | 2026-07-08 |
| 98 | agents-from-scratch | 894 | 225 | Python | 4 | Build AI agents from first principles using a local LLM - no frameworks, no cloud APIs, no hidden reasoning. | 2026-01-14 |
| 99 | eclaire | 883 | 90 | TypeScript | 0 | Local-first, open-source AI assistant for your data. Unify tasks, notes, docs, photos, and bookmarks. Private, self-hosted, and extensible via APIs. | 2026-05-14 |
| 100 | local-talking-llm | 876 | 191 | Python | 6 | A talking LLM that runs on your own computer without needing the internet. | 2026-04-04 |